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MULTI-MODE ULTRASONIC SYSTEM 
BACKGROUND 

[0001] Ultrasonic (US) pen systems generally include a pen and a panel. A use^r 

may use the pen to write on the panel The pen may generate ultrasonic signals which 
file panel digitizes and provides to a computer. Thus, the signals transndtted by the pen 
may be utilized by one or more applications to perform operations on infomiation 
presented on the display. 

[0002] Ultrasonic pen system may be used in multiple operating modes such as, 

e.g., a write mode and an erase mode. System designs that permit users to switch 
between operating modes would find utility. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0003] The detailed description is provided wifh reference to (he accompanying 

figures. In the figures, &e left-most digit(s) of a reference number identifies ttie figure in 
which flie reference number first appears. The use of the same reference numbers in 
difiTerent figures indicates similar or identical items. 

[0004] Fig. 1 is a schematic illustration of a multi-mode ultrasonic system 
according to an embodiment. 

[0005] Fig. 2 is a schematic illostration of aspects of an ultrasonic transmitting 
device according to an embodiment. 

[0006] Fig. 3 is a flowchart iUustratmg operations executed by an operating 
mode module according to an embodiment 

[0007] Fig. 4 is a flowchart illustrating operations executed by an application 
according to an embodiment 

[0008] Fig. 5 is a schematic illustration of an ultrasonic system according to an 

embodiment. 

[0009] Pigs. 6 illustrate is a flowchart illustrating operations of a method to 
determine the location of an ultrasonic signal generator according to an embodiment 

[0010] Pig. 7 is a flowchart illustrating operations in a metiiod to estnnate the 

time difference of arrival (TDOA) of a pair signals according to an embodhnent 
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[0011] Fig. 8 is a schematic illustration of a inulti-mode ultrasonic system 

according to an embodiment 

[0012] Fig. 9 is a schematic illustration of a computing system according to an 

embodiment. 
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DETAE-ED DESCRIPTION 

(0013] In the following desoiption, numerous specific details are set forth in 

order to provide a thorough understandmg of various ^nbodim^ts. However, various 
einbodiinents of tiie invention may be practiced without the specific details. In other 
instances, well-known methods, procedures, coinponents, and circuits have not been 
described in detail so as not to obscure the particular embodiments of the invention. 

[0014] Fig. 1 is a schematic illustration of a multi-mode ultrasonic system 
according to an embodiment Ultrasonic system ICQ may include an -ultrasonic 
transmitting device 102 that generates and transmits one or more ultrasonic signals. The 
ultrasonic transnutting device 102 may be any suitable device that includes one or more 
ultrasonic transducers to generate ultrasonic signals. For exanq>le, the ultrasonic 
transmitting device 102 may be embodied in a housing in the shape of a pen, such as 
illustrated iu Fig. 1. 

[001 5] System 1 00 ma^ fiirther include an ultrasonic tracking assembly that 
includes one or more \il1rasonic seiuiors (or receivers) 106 (e.g., 106A, 106B, 106C, 
etc.), a digitizer 108, an operating mode module 1 10, a tracking module 120, and a 
display panel 104. The sensoTs 106 may be any suitable ultrasonic sensor such as a 
miarophone or the like. The s^ors 106 may be coupled to digitizer 108 to convert the 
analog ultrasonic signals received by the sensors 106 (e.g., firom the ultrasonic 
transmitting device 102) into digital format 

[0016] For exaxnple, digitizer 108 may include an analog to digital (A/D) 

converter, a signal sampling logic, or the like. Digitizer 108 may be implemented in any 
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suitable location such as within flie panel 104, within a coniputing device or the like. 
The digital signals from the digitizer 108 may be provided to an operating mode module 
1 10 that utilizes one or mote charactoistics of the signal to determine an operating 
mode of tiie ultrasonic transmitting device 1 02 and a tracking module 1 20 that 
determines a location (or coordinates) of tiie ultrasonic transmitting device 102 based on 
the digital signals. The operating mode module 110 and the tracking module 120 may 
be provided as hardware^ software, firmware, or combinations thereof in various 
embodiments. In one axibodiment, tracking module 120 may use the time difference of 
arrival (TDOA) of the digital ultrasonic signals to determine (or estimate) ttxe location of 
the ultrasonic transniittfaig device 102. 

[001 7] In embodiments, tracking module 1 20 may be coupled to a memory 130 

that stores an application 132. Hence, the tracking module 120 may provide the location 
of the ultrasonic transmitting device 102 to the application 132. The location of the 
ultrasonic transmitting device 102 may be relative coordinates with respect to tiie panel 
104 and/or the sensors 106. The sqppUcation 132 may use the coordinates of the 
ultrasonic transmittiDg device 102 to manage user inputs. 

{001 8] The panel 1 04 may be any suitable panel such as a panel integrated in a 
con:q>uting device. Moreover, the panel 104 may be integrated in a tablet conoputing 
device, e.g., as tiie tablet (or screen) that a user may interact with The panel 104 may 
also be a separate device that is coupled to a confuting device via a bus. Ultrasonic 
transmitting device 102 may generate idtrasonic signals (e.g., when the tip of tiie pen 
(102) is pressed against, touches, or is in proxhnity to tiie panel 104). Hence, the 
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ultrasonic transmitting device 102 may include one or more suitable ultrasonic 
transmitters (or transducers). 

[0019] In one embodiment, system 100 may utilize one or more characteristics 
of ultrasonic signals fiom an ultrasonic taransmitting device to determiiie an operating 
mode for ultrasonic transmitting device 1 02. For exanople, in a first operating mode 
ultrasonic transmitting device 1 02 may be used to write on a panel 1 04, while in a 
second operating mode, ultrasonic transmitting device 102 may be used to erase on a 
panel. In one ^bodiment, a pulse frequency of the ultrasonic signal may be used to 
distmguish between a first operating mode and a second operating mode. In alternate 
embodiments other signal characteristics such as, e.g., an anq^litude, a modulated pulse 
fi:equency, or the like may be used to distinguish between operating modes. 

10020) Fig. 2 is a schematic iUusfration of aspects of an ultrasonic transmittmg 
device 102 according to an embodiment Referrmg to Fig. 2, ultrasonic transmitting 
device 102 may include a switching mechanism 210 that permits an input line to be 
switched between a first iiq}ut voltage and a second ii^ut voltage. In the embodiment 
depicted in Fig. 2, the first input voltage may correspond to VCC and the second input 
voltage may correspond to ground (0>]D). VCC may be a function of the design of 
circuitry in the ultrasonic transmittnig device. In one embodiment switching mechanism 
may be embodied as a toggle switch in the housing of ultrasonic transmitting device. In 
alternate embodiments, switching mechanism 210 may be inq>lemented as a digital 
switch, or the like. 

[0021] The input voltage from switching mechanism is directed to a pulse 
generator 220, which generates an electronic pulse in response to the input voltage. In 
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one embodiment, pnlse generator 220 may be embodied as a microcontroller unit 
(MCU). In one embodiment, pulse generator 220 generates a high-frequency digital 
pulse train 222 in response to a high input voltage such as, e.g., VCC, and a low 
frequency digital pulse train 224 in response to a low input voltage such as, e.g,, GND. 
In altemate embodiments pulse generator 220 generates a low-frequency digital pulse 
train 222 in response to a high input voltage such as, e.g., VCC, and a hi^ frequency 
digital pulse train 224 in response to a low input voltage such as, e.g. , GND. Thus, 
changing the input voltage at switching mechanism causes a corresponding change in 
the frequency of the electronic pulse train from pulse generator 220. 

(0022] The electronic pulse tram from pulse generator 220 is input to an 
oscillator circuit 230. In one embodiment, oscillator circuit 230 may be implemented as 
a parallel RLC circuit that drives an ultrasonic transmitter 232. Ultrasonic transmitter 
232 generates an ultrasonic signal in response to flie frequency oscillator circuit. In one 
embodiment, ultrasonic transmitter 232 produces an ultrasonic signal 242 having a high 
pulse frequency in response to a high-frequency electronic pulse train 222 and an 
ultrasonic signal 244 having a low pulse frequency in response to a low-frequency 
electronic pulse train 224. In an altemate embodiment, ultrasonic transmitter 232 
produces an ultrasonic signal 244 having a low pulse frequency in response to a high- 
frequency electronic pulse train 222 and an ultrasonic signal 242 having a high pulse 
frequency in response to a low-frequency electronic pulse train 224. 

[0023] Referring back to Fig. 1 , the ultrasonic signal 242, 244 produced by 

ultrasonic transmitter 232 is received by one or more of the sensors 106A, 106B, 106C, 
which generate an electrical signal that is a frmction of die received ultrasonic signal 
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242, 244. The electrical signals generated by one or more of sensors 106A, 106B, 106C 
may be input to a digitizer 108, which digitizes the signals. The digitized signals 
maintain information about the pulse frequency of the ultrasonic signal 242, 244 
received by one or more of flie sensors 106A, 106B, 106C. Optionally, digitizer 108 
may combine the electrical signals into a composite signal. 

[0024] The digitized signal(s) from digitizer 108 are input to an operating mode 
module 1 10, which generates a signal that is a fimction of the pulse frequency of the 
received ultraisonic signal 242, 244. Fig. 3 is a flowchart illustmting operations 
executed by operating mode module 110, according to an embodiment Referring to 
Fig. 3, at operation 305 the operating mode module 110 receives one or more signals 
from the digitize 108. If, at operation 310, the signal(s) from digitizer 108 indicate that 
the pulse frequency of the received ultrasonic signal 242, 244 is not greater than a 
threshold^ then control passes to operation 315 and operating mode module 110 
generates a signal that indicates that the ultrasonic transmitter is qpraating in an erase 
mode. By contrast, if at operation 3 1 0 the signal(s) indicate that the pulse frequency of 
the received ultrasonic signal 242, 244 is greater than a threshold, then control passes to 
operation 320 and operating mode module 110 generates a signal tiiat indicates that the 
ultrasonic transmitter is operating in write mode. At operation 325 the signal generated 
by operating mode module 1 10 is passed to an application 132. 

[0025] In one embodiment, j^rptication 1 32 may use the operating mode 

indicator signal generated by operating mode module to select an operation to be 
executed on the display 104. Fig. 4 is a flowchart illustrating operations executed by 
application 132, according to an embodimjent. Refentng to Fig. 4, at operation 405 the 
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application 132 receives one or more operating mode signals from the operating mode 
module 1 1 0. If, at operation 41 0, the signal(s) from operating mode module 110 
indicate that the transmitter is operating in' write mode, then control passes to operation 
415 and operating mode module 1 10 Bpphes a write operation to a location on the 
display 104. By contrast, if at operation 410 the signal(s) from from operating mode 
module 110 indicate that the transmitter is operating in erase mode, then control passes 
to operation 420 and operating mode module 1 10 applies an erase operation to a 
location on ibe display 104. 

[0026] Referring back to Fig. 1 , in one embodiment the system 100 includes a 

tracking module 120 to determine the location of ultrasonic transnnttmg device 102 in 
relation to the display 104. In one embodiment the tracking module 120 utilizes the 
time difference of arrival (TDOA) of the ultrasonic signals collected by sensors 106A, 
106B, 106C to determine (or estimating) the location (or coordinates) of the ultrasonic 
transmitting device 102. 

[00Z7] Fig. 5 is a schematic illustration of an embodiment of an ultrasonic 
tracking system 500 according to an embodiment The system 500 may include the 
ultrasonic signal generator 102 and an array of ultrasonic receivers 502 to receive the 
generate ultrasonic signals. The array of ultrasonic receivers 502 may correspond to the 
receivers 106A, 106B, 106G in the embodiment depicted in Fig. 1. As discussed wifli 
reference to Fig. 1 , the ultrasonic signals from the ulixasonic signal generator 1 02 may 
be digitized (e.g., by the digitizer 108) prior to providing the signals to a traddng 
module 120. Furthermore, the array 502 may digitize the generated ultrasonic signals in 
an embodiment 
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[0028] Fig. 6 is a flowchart illustrating operations executed by tracking module 
120» according to an embodiment Referring to Fig. 6, at operation 610 aplurality of 
pairs of the digitized ultrasonic signals from digitizer 108 may be selected (e.g., from at 
least dnree of the sensors in the array 502). Hence, the plurality of selected pairs may be 
used to form two or more pairs of digital ultrasonic signals. For example, the tracking 
module 120 may include one or more TDOA modules 504 (such as 506 and 508). The 
TDOA modules 504 may perform operation 610 in an embodiment For instance, the 
TDOA module 506 may select the signals from a pair of receivers (e.g., 508 and 510) 
and the TDOA module 512 may select the signals from another pair of receivers (e.g, 
514 and 516). 

[0029] * At operation 615, the time difference of arrival (TDOA) of each of flie 
pairs of the stage 506 are estimated (e.g., by the TDOA modules 204). At operation 620 
the intersection of each pair of the TDOA estimated digital ultrasonic signals are 
detemiined, e.g., by one or more intersection locator(s) 518. At operation 625 a 
clustering module 520 may utilize a plurality of the intersections to form a cluster. In 
one embodiment, the clustering module 520 may optionally exclude (operation 630) one 
or more of ttie intersections from the cluster, e.g., because the exdudedinter5ection(s) 
are more than a threshold distance from other members of the cluster. In an optional 
operation 635, the clustering module 520 may weight the intersections in the cluster 
according to the distance between the ultrasonic transmitdng device 102 and the 
respective receiver (502). H^ce, the closer receivers may render a more accurate result 
and may be weighted higher. 
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[0030] At operation 640, the location (or coordinates) of the ultrasonic 
traxismitting device 102 is deteimtned which corresponds to at least one of the 
intersections. In one embodiment^ the center of flie cluster may be selected as the 
location of the ultrasonic transmitting device lOZ In one embodiment, the method may 
be utilized for any ultrasonic pen^ e.g., since any iiltrasonic signal generated by an 
ultrasonic transmitting device (102) may be utilized to determine the location of the 
ultrasonic transmitting device (102). 

[0031] Fig. 7 is a flowchart illustrating operations in a method to estimate the 
time difference of arrival (TDOA) of a pair signals. In one enibodiment, the method 
may be utilized to perform the stage 615 of Fig. 6. Furthermore, each of the TDOA 
modules 504 of Fig. 5 (e.g.^ modules 506 and/or 512) may be utilized to perform the 
stages of the method. 

[0032] The stages 710A and 710B calculate the fest Fourier transform (FFT) of 
a pair of digital ultrasonic signals according to the following: 

where (0) is the FFT, (t) is the digital ultrasonic signal,/iv is the 
frequency element at w, and t is time. 

[0033] At the stage 7 IS; the crosspower-spectrum of the pair from the stages 502 
and 504 is calculated as follows: 

where X" (fl>) is the coiq'ugate versicm of Xf (©) . 
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[0034] At a stage 720, the generalized cross-correlation (GCC) of the 

crosspower-spectrum of the stage 506 is calculated as follows: 

[0035] In an embodunent, the weighting function W (^) may be any suitable 

weighting function, such as ML (maximiiin likelihood), PHAT (phase fiansfonn), 
modified PHAT criterion, or the tike. In some embodiments, ML may be sensitive to 
reverberation and/or non-stationary noise. Since PHAT is less sensitive to reverberation, 
the modified PHAT criterion may be selected as the weighting function where potential 
for reverberation and/or non-stationary noise may be present 

[0036] At a stage 72S the peak position of the OCC of Ifae stage 508 is 
determined to determine the TDOA as follows: 
tfy =argmax/^(T) 

r 

[0037] Fig, 8 is a schematic illustration of an embodiment of a multi-mode 
ultrasonic systan 800. The system 800 may determine an operating mode of the 
ultrasonic transntutting device, track the location of the ultrasonic transmitting device 
1 02 relative to the panel 104, and ^ly an operation to the location on the panel 104 
based on the operating mode of the transmitting device 102. The one or more ultrasonic 
sensors (or receivers) 106 receive the generated ultrasonic signals and provide than to 
the digitizer 1 08. As discussed with reference to Pig. 1 , the digitizer 1 08 may include an 
A/D converter, a signal sampling logic, or the like. An A/D converter of the digitizer 
108 may be utiUzed to convert the analog uUzasonic signals to digital format The digital 
ultrasonic signals may be provided to a univ^al serial bus (USB) client 802 to be 
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communicated to a host-based dnver 804 ttirough a USB bus 805. Other bus topologies 
may also be utilized such as those discussed with reference to bus 922 of Pig. 9. 

[0038] The bus 805 may be coiq>Ied to a USB host 806 of the driver 804 to 
receive the digital ultrasonic signals and provide them to the operating mode module 
1 10 and the tracking module 120. In an embodiment^ Ike operating mode module 110 
and the tracking module 120 may be embodied as described above. The operating mode 
The tracking module 120 determines the location (or coordinates) of the ultrasonic 
transmitting device 202 and provides the location to a standard audio input device 
(SAID) 808. The SAID 808 may support some pen/mouse applications (1 14) without 
any change. For exainple, the location may be provided to a standard interface (SAID 
808) and follow that interface for ^lication.(l 14) call-backs. As discussed with 
reference to Fig. 1, the coordinates of the ultrasonic transmitting device 102 may be 
directly provided to the application 1 14. 

[00391 Fig. 9 illustrates a block diagram of a contputing system 900 in 

accordance with an raibodiment of fhe invention. The concputing system 900 may 
include one or more central processing unit(s) (CPUs) 902 or processors coupled to an 
interconnectiomietwork (or bus) 904. The processors (902) may be any suitable 
processor such as a general purpose processor, a network processor, or the like 
(including a reduced instruction set con^iuter (RISC) i>rocessoT or a conqplex instruction 
set computer (CISC)). Moreover, the processors (902) may have a single or multiple 
core design. The processors (902) with a multiple core design may integrate different 
types of processor cores on the same integrated circuit (IC) die. Also, fhe processors 
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(902) with a multiple core design may be implemented as symmetrical or asymmetrical 
multiprocessors. 

[0040] A chipset 906 may also be coupled to the interconnection network 904. 
The chipset 906 may inchide a memory control hub (MCH) 908. The MCH 908 may 
include a memory controller 910 that is coupled to a memory 912. The memory 912 
may store data and sequences of instructions that are executed by the CPU 902, or any 
other device included in the computmg system 900. In one embodiment of Hie invention, 
the memory 912 may include one or more volatile storage (or memory) devices such as 
random access memory (RAM), dynamic RAM (DRAM), synchronous DRAM 
(SDRAM), static RAM (SRAM), or the like. Nonvolatile memory may also be utiUzed 
such as a hard disk. Additional devices may be coupled to the interconnection network 
904, such as multiple CPUs and/or multiple system memories, 

[0041] The MCH 908 may also include a graphics interface 914 coupled to a 

graphics accelerator 916. In one enlbodiment of the invention, the gr£q)hics interface 914 
may be coiq)led to the gr^hics accelerator 916 via an accelerated gr£q>hics port (AOP). 
In an embodiment of the invention, a display (such as a flat panel display) may be 
coupled to the graphics interface 914 through, for example, a signal converter that 
translates a digital representation of an image stored in a storage device such as video 
inemory or system memory into display signals fliat are int^reted and displayed by the 
display. The display signals produced by the display device may pass through various 
control devices before being interpreted by and subsequently displayed on the display. 

[0042] A hub interface 91 8 may coiq^le the MCH 908 to an input/output control 
hub (ICH) 920. The ICH 920 may provide an interface to input/ou^ut (I/O) devices 
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coupled to the computing system 900. The ICH 920 may be coupled to a bus 922 
through aperipheral bridge (or controller) 924, such as a peripheral conponent 
interconnect (PCI) bridge, a universal serial bus (USB) controller, or the like. The 
bridge 924 may provide a data path between the CPU 902 and peripheral devices. Other 
types of topologies may be utilized Also, multiple buses may be coupled to the ICH 
920, e.g., through multiple bridges or controllers. Moreover, other peripherals coupled 
to the ICH 920 may include, in various embodnnenfs of the mvention, integrated drive 
electronics (IDE) or small cornputer system interface (SCSI) hard drive(s), USB port(s), 
a keyboard, a mouse, parallel port(s), serial port(s), floppy disk drive(s), digital output 
support (e.g., digital video interface (DVI)), or the like. 

[0043] The bus 922 may be coupled to an audio device 926, one or more disk 
drive(s) 928, and a network interface device 930, Other devices may be coupled to the 
bus 922. Also, various conoponents (such as the network interface device 930) may be 
coupled to the MCH 908 in some embodiments of the invention. In addition, the CPU 
902 and the MCH 908 may be combined to form a single chip. Furthermore, the 
graphics accelerator 916 may be included within the MCH 908 in other enibodiments of 
the inventioiL 

[0044] Additionally, the computing system 900 may include volatile and/or 
nonvolatile memory (or storage). For eTcample, nonvolatile memory may include one or 
more of the following: read-^jnly memory (ROM), programmable ROM (PROM), 
erasable PROM (EPROM), electrically BPROM (BBPROM), a disk drive (e.g., 928), a 
floppy disk, a compact disk ROM (CD-ROM), a digital versatile disk (DVD), flash 
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memoiy, a magneto-optical disk» or o&er types of nonvolatile machine-readable media 
suitable for storing electronic instructions and/or data. 

[0045] Thus, described herein are systems and methods for a multi-mode 
ultrasonic system in which fiie operating mode of fhe system may be set at the ultrasonic 
transmitting device 102, e.g., by altering one or more characteristics of the ultrasonic 
signal emitted by the ultrasonic transmitting device 102. In one embodiment the pulse 
frequency of the ultrasonic signal may be set to a first frequency to isrplem&it a write 
operation and a second frequency to inq>lement an erase operatioa The particular 
frequencies of the settings are not critical In one embodiment the write mode may be 
set to a relatively higher frequency than the orase mode, which reduces power 
consumption. For e3can:q)le, in write mode fhe ultrasonic transmitter 102 may trao^^ 
an ultrasonic signal at a frequency in the range of 60-80 Hz, while in (he erase mode the 
ultrasonic transmitter may transmit an ultrasonic signal at a frequency in fhe range of 
30-40 Hz. Alternate embodiments may permit three or more modes of operation by 
vaiying signal characteristics in three or more distinct fashions. In addition, altemate 
en[]bodiments may vary signal characteristics other than the pulse frequency such as e.g., 
the amplitude, fhe modulated pulse frequency, or the like. 

[0046] In various einbodiments, one or more of fhe operations discussed herein, 
e.g., with reference to Figs. 1-9, may be implemented as hardware (e.g., logic circuitry), 
software, firmware, or combinations thereof, which may be provided as a computer 
program product, e.g., including a machine-readable or con^uter-readable medium 
having stored thereon instmctions used to program a computer to perform a process 
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discussed herein. The machine-readable medium may inchide any suitable storage 
device such as those discussed with reference to Figs. 1 and 9. 

[0047] Additionally, such coxr^uter-readable media may be downloaded as a 
computer program product, wherein flie program may be transfixed from a remote 
computer (e.g., a server) to a requesting conq)uter (e.g., a client) by way of data signals 
embodied in a carrier wave or other propagation medium via a communication link 
(e.g., a modem or network connection). Accordingly^ herein, a carrier wave shall be 
regarded as corrprising a machine-readable mediunt 

[0048] Reference in liie specification to "one embodunenf ' or ''an eniibodiment" 

means that a particular feature, structure, or characteristic described in connection with 
that embodiment may be included in at least an implementation. The appearances of the 
phrase '4n one enibodimenf ' in various places in the specification may or may not be all 
referring to the same embodiment 

[0049] Also, m the descrq)tion and claims, the t&nns ^*coiq)led" and "connected," 
along with their derivatives, may be used In some embodiments, "coimected" may be 
used to indicate that two or more elements are in direct physical or electrical contact 
with each other. ''Coupled'* may mean that two or more elements are in dhrect physical 
or electrical contact However, "coupled" may also mean fliat two or more elements may 
not be in direct contact with each other, but may still cooperate or interact with each 
other. 

[0050] Thus, althou^ embodiments of the invention have been described in 

language specific to structural features and/or methodological acts, it is to be understood 
that claimed subject matter may not be limited to the specific features or acts described. 
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Rather, the specific features and acts are disclosed as saniple fonns of inq>leinentmg the 
claimed subject matter. 



